Preliminary results on grasping with vision and touch
نویسندگان
چکیده
This paper presents initial results in integrating touch with vision for delicate manipulation tasks. A generalizable framework of behavioral primitives for tactile and visual feedback control is proposed. Since vision provides position and shape information at a distance, while tactile provides small-scale geometric and force information, we focus on the complimentary roles of vision and touch. We demonstrate that visual feedback can perform the rough positioning needed for tactile sensor feedback, and that grasp force and object orientation angles can be sensed and controlled with tactile sensing. A force sensor based approach provided a comparison measure, and we observed that the use of tactile sensing results in a much more gentle grasp.
منابع مشابه
The Feeling of Success: Does Touch Sensing Help Predict Grasp Outcomes?
A successful grasp requires careful balancing of the contact forces. Deducing whether a particular grasp will be successful from indirect measurements, such as vision, is therefore quite challenging, and direct sensing of contacts through touch sensing provides an appealing avenue toward more successful and consistent robotic grasping. However, in order to fully evaluate the value of touch sens...
متن کاملMore Than a Feeling: Learning to Grasp and Regrasp using Vision and Touch
Past work in robotic grasping often relied purely on vision; However, human grasping heavily rely also on touch. While vision provides coarse-grained information about object location, shape, and size, touch provides complementary fine-grained cues about contact forces, textures, local shape around contact points, and deformability, all of which are critical for evaluating an ongoing grasp. In ...
متن کاملGrasping without Sight: Insights from the Congenitally Blind
We reach for and grasp different sized objects numerous times per day. Most of these movements are visually-guided, but some are guided by the sense of touch (i.e. haptically-guided), such as reaching for your keys in a bag, or for an object in a dark room. A marked right-hand preference has been reported during visually-guided grasping, particularly for small objects. However, little is known ...
متن کاملTemporal prediction of touch instant during observation of human and robot grasping.
The aim of the present work was to test the ability to predict the instant at which a grasping hand touches an object. Our hypothesis was that, because of the activation of the mirror-neuron system, the same predictive process necessary for action execution should be active during observation. Experimental evidence indicates, however, that not only observed actions but also observed objects aut...
متن کاملAchieving Dextrous Grasping by Integrating Planning and Vision-Based Sensing
This paper deals with the automation of dextrous grasping in a partly known environment using a stereo vision system and a multiingered hand mounted on a robot arm. EEective grasping requires a combination of sensing and planning capabilities: sensing to construct a well-adapted model of the situation and to guide the execution of the task, and planning to determine an appropriate grasping stra...
متن کامل